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Abstract 

Objective. To assess whether there is a relationship between having qualitjr as an item on the board's agenda, perceived external 
pressure (PEP) and the implementation of qualitjr management in European hospitals. 

Design. A quantitative, mixed method, cross-sectional study in seven European countries in 2011 surveying CEOs and qualitjr 
managers and data from onsite audits. 

Participants. One hundred and fiftjr-five CEOs and 155 quaUt}' managers. 

Setting. One hundred and fifty-five randomly selected acute care hospitals in seven European countries (Czech Republic, 
France, Germany, Poland, Portugal, Spain and Turkey). 

Main outcome measure(s). Three constructs reflecting quality management based on questionnaire and audit data: (i) Qualitjr 
Management System Index, (ii) QuaHtjr Management Compliance Index and (iii) Clinical Quality Implementation Index. The 
main predictor was whether quality performance was on the executive board's agenda. 

Results. Discussing quality performance at executive board meetings more often was associated with a higher qualityr manage- 
ment system score (regression coefficient b = 2.53; SE = 1.16; P= 0.030). We found a trend in the associations of discussing 
quality performance with quality compliance and clinical quality implementation. PEP did not modify' these relationships. 

Conclusions. Having quaUtjr as an item on the executive board's agenda allows them to review and discuss quality performance 
more often in order to improve their hospital's quality management. Generally, and as this study found, having quality on the 
executive board's agenda matters. 
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Introduction 

Executive boards in hospitals are under increasing pressure to 
assure and improve the quality of care delivered to patients. They 
have to improve management systems to meet the demands of a 
wide range of stakeholders [1]. External pressures such as ac- 
creditation [2, 3], publicly available performance data [4, 5] and 
market competition [6] have been associated with organizational 
changes. Since executive boards have the responsibilit}' of daily 
management of the hospital, external pressures can play a 
pivotal role in the prioritization and agenda-setting of the execu- 
tive board. Agenda setting is considered to be the starting point 
of prioritization and decision-making [7], and having quality on 
the agenda should allow executive board members to review 
and discuss the quality and performance of the services they 
deliver to patients. 

However, it is not self-evident that executive boards drive the 
quaUtjr and safety agenda within their organizations. Executive 
boards tend to primarily focus on the hospital's financial health, 
at the expense of considering quaUt}' and safety' issues [8—10]. 
The lack of active engagement of executive boards in quality 
of care aMgns with the growing concern that (financial) incen- 
tives within healthcare systems are often failing to support 
quality improvement (QI), i.e. the business case for quaUtjr is 
lacking [11]. 

In previous studies, the executive board's engagement was 
found to be associated with the successful implementation of 
QI projects [12—14], for example, by facilitating a supportive 
IT systems [15] and stimulating clinical involvement in total 
quaUt}' management [16]. Executive board's engagement was 
also found to be associated with adequately funded and sys- 
tematically evaluated quaHtjr management systems [17, 18]. A 
quality management system has been defined as a set of inter- 
acting activities, methods and procedures used to monitor, 
control and improve the quaUt)' of care [19], and is considered 
to be a prerequisite for the successful implementation of single 
QI projects [20] and to achieve sustainabUit)'. 

There are different ways to assess quality management systems 
[21], but whichever assessment wis used, the implementation of 
quality management systems appeared to differ between hospitals 
[20, 22—25]. Thus far, it remains unclear why the implementation 
of quality management systems differs. 

Against this background, the aims of our study were to (i) de- 
termine how often executive boards have quaUt}' performance as 
an item on the agenda, (ii) investigate the relationship between 
having quaUt}' on the board agenda and the implementation of 
qualit}' management in hospitals, and finally to (Mi) explore the 
influence of external pressure on this relationship. 

Methods 
Participants 

This study was part of the 'Deepening our Understanding of 
Quality improvement in Europe (DUQuE)' project, funded 
by the EU 7th Research Framework Program [26]. Its aims 
and methods are described elsewhere [27]. The study used a 



multi-method, cross-sectional design to collect qualitjr-related 
information from European hospitals between May 2011 
and February 2012 [27]. Seven countries were included based 
on a mix of health and hospital system financing and organi- 
zation criteria in different geographical areas in Europe. 
The participating countries comprised the Czech Republic, 
France, Germany, Poland, Portugal, Spain and Turkey. In each 
country, 30 hospitals were randomly recruited, subject to them 
having more than 130 beds and that they treat acute myocar- 
dial infarct, hip fracture, stroke and deliveries patients [27]. 

Measuring the constructs 

We sent a questionnaire to the Chief Executive Officers (CEOs) 
to assess how frequentiy qualit}' performance was an item on 
the Executive board's agenda: (i) never, or during, (ii) a few, (Mi) 
most, or (iv) every? meeting. 

The implementation of hospital-wide quality' management 
was measured using three constructs that focused on (i) 
organization-wide systems, (M) compliance and (iM) clinical 
quality efforts. The implementation of the quality management 
system was determined by the construct Quality Management 
System Index (QMSI) [28]. This was based on the quality 
manager questionnaire and consists of (i) quaUtjr policy docu- 
ments, (u) qualitjr monitoring by the board, (Mi) training of pro- 
fessionals, (iv) formal protocols for infection control, (v) 
formal protocols for medication and patient handUng, (vi) ana- 
lysing performance of care processes, (vM) analysing perform- 
ance of professionals, (vMi) analysing feedback patient 
experiences and (ix) evaluating results. The QMSI ranges from 
0 to 27. The level of compUance was measured using the con- 
struct ^aa//^' Management Compliance Index (QMCI) [29]. It is 
based on audit data and assesses (i) quality planning, (M) moni- 
toring patient/professional opinion, (Mi) monitoring quaHty 
systems and (iv) improving quaMt)' by staff development. The 
QMCI ranges from 0 to 16. Third, the Clinical Quality 
Implementation Index (CQII) [29], which is also based on audit 
data, assesses (i) preventing hospital infection, (M) medication 
management, (Mi) preventing patient falls, (iv) preventing 
patient ulcers, (v) routine testing of elective surgery patients, 
(vi) safe surgery practices and (vM) preventing deterioration. 
The CQII ranges from 0 to 14. 

Perceived external pressure 

Perceived external pressure (PEP) reflects the CEO's percep- 
tion of the influence external factors from outside the hospital 
have on the hospital's quality management system. Since there 
was no validated scale to measure PEP, we asked experts from 
the participating countries to provide an overview of pressures 
applicable to hospitals in their country. We identified 1 8 differ- 
ent external influencing factors (Table 2). Because the 
meaning of these factors might differ across national cultures 
and regulatory environments, the items were discussed with 
the national coordinators from each country as part of the 
translation process. In the questionnaires, CEOs could indicate 
how much they considered each single item to have influence 
on their quaMty management system (0, no influence; 
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1, moderate influence; 2, major influence). The composite 
measure of PEP was constructed by the sum score of 1 8 exter- 
nal influencing factors. Items were not weighted since it was 
beyond the scope of this study to determine which factors are 
more important than others. The composite measure for PEP 
ranges from 0 to 36. 

Data collection process 

Countryr coordinators approached and recruited hospitals for this 
study. Hospital coordinators forwarded passwords to the CEO 
and quality manager to access the web-based questionnaires. 
In total, 188 hospitals agreed to participate. Questionnaires were 
completed by 177 (RR = 94"/o) CEOs and 188 quality' managers 
(RR = 100"/o). We collected audit data during onsite visits within 
a subsample of 12 hospitals that were randomly selected from the 
30 participating hospitals per country. 

Statistical analyses 

Data cleaning was performed prior to the statistical analyses. 
In our data, 53 out of 188 (28.19%) hospitals were missing at 
least one value for QMSI and 84 out of 188 (44.68%) of hos- 
pitals were missing at least one of the external influencing 
factors that were used to build the PEP score. In order to miti- 
gate this, we used multiple imputation to obtain data sets that 
were complete on subscale variables used to buUd QMSI and 
PEP. The estimated values were based on the items that were 
completed by the respondent and on the same item answered 
by other respondents. Instead of a single fixed value, multiple 
imputation replaces missing values with a set of plausible 
values to represent practical uncertainty [30] . It generated five 
complete data sets and these were used to construct scores of 
QMSI, QMCI, CQII and PEP for hospitals that missed less 
than half of the variables used to buUd each scale. Hospitals 
missing more than half of the variables were excluded from the 
analyses. This allowed us to increase our final sample si2e to 1 55 
hospitals. Since only two CEOs indicated that they never dis- 
cussed quality performance, we combined this answering cat- 
egory with 'during few meetings' in fiirther analyses. Audit data 
(i.e. QMCI and CQII) were collected in 63 of the 1 55 hospitals. 

Descriptive statistics were calculated to describe hospital 
characteristics (teaching status, ownership and size) and demo- 
graphic characteristics of participating CEOs and quality managers 
(gender, age and number of years in job). Descriptive statistics are 
also reported for the QMSI, QMCI and CQII (outcomes) and 
how often was quality on the Board's agenda (predictor) in the 
analysis. 

We used the Directed Acyclic Graph (DAG) shown in Fig. 1 
to guide our analysis. We analysed the relationship between the 
frequency of having quaUt}' on the executive board's agenda 
(predictor) with the implementation of quaUtjr management as 
measured by QMSI, QMCI and CQII (outcomes). We used 
linear random intercept models to estimate associations 
between each of our three outcomes (QMSI, QMCI, CQII) and 
the frequency of quaUtjr on the agenda and to assess whether 
PEP modified this predictor— outcome relationship. Models 
included a random intercept for country in order to account for 



Hospital confounders 



Frequency of having 




quality on the Implementation of 

executive board's quality management 

agenda 

Figure I The DAG shows the relationship between the 
frequency of having quality on the executive board's agenda 
and the implementation of quaUt}' management. Hospital 
confounders are teaching status, ownership, the number of 
beds and the country the hospital is situated in. PEP is the 
CEO's perception of external pressure on the hospital's quaUtjr 
management system. PEP is hjrpothesized to by a modifier of 
the relationship between the quality agenda and qualitjr 
management. 

clustering of hospitals within countries. We also adjusted for 
hospital confounders such as CEO background in healthcare, 
hospital teaching status, ownership type and number of beds 
because we expect that these variables might influence the fre- 
quenqr of having quality on the agenda. To determine statistical 
differences, the level of significance was set at 5%. AU statistical 
analyses were carried out in SAS (version 9.3, SAS Institute Inc., 
NC, USA, 2001). 

Results 

Quality on the executive board's agenda 

As can be seen in Table 1, the 155 hospitals are non-teaching 
(55.5%) and teaching (44.5%), and 80% of the hospitals are 
publicly owned. The executive boards comprised eight 
members on average. Further analyses showed that the average 
number of executive board members in France and Spain is 
more than 10, while in Germany, Poland and Portugal, boards 
have four or five members (not in the table). CEOs indicated 
that the executive boards have 36 official meetings per year on 
average, and 54% had quaUt}' performance on the agenda 
during most meetings. Sevent)'-nine per cent of the executive 
boards had at least one member with medical background. 

Quality management 

The implementation of qualit}' management was described by 
QMSI, QMCI and CQII. As shown in Table 1, the average 
score on QMSI was 19.16 (±4.48) on a scale of 0-27. This 
means that the majority of hospitals fuUy implemented quality 
activities in at least one unit. The QMCI score was 10.52 
(+3.18) on a scale of 0—16, meaning that the majority' of 
hospitals demonstrated compliance to a set of activities to 
plan, control and monitor quaUt}' of care. Hospitals scored 
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Table I Descriptive statistics for the outcome, predictors, and characteristics of hospitals, CEOs and quaMt}' managers used in 
the analysis (;z = 155)" 



Hospital characteristics 


Teaching status, (/o) 






Non- teaching 


oo [pDAo) 




ieacning 


DV (44. J Z) 




CJwnership, « (yo) 






Private 


J I (ZU.UU) 




Public 


1 o /I /on r\r\\ 

124 (oO.UU) 




Number of beds, n (%) 






<200 


15 (y.68) 




ZUl— jUU 


/C/r /An CQ\ 

00 (4Z.0oJ 




cm 1 nnn 
dUI— iUUU 


4o [pu.y I) 






ZO (10. / 1) 




board size, mean [oU) 


7.93 (6.Z5) 




Members with medical background, /7- (%) 






0 members 


99 /I /I 1 0> 
ZZ (^14. iVJ 




1 member 


CC /^C /1Q\ 
DO (JD.4o) 




2 members 


/1 9 ^97 1 ^^ 
4Z (^Z / . 1 U) 




3 or more members 


ZD (lO. / /) 




Missing 


lU (D.4Dj 




Number of official Board meetings per year, mean (SD)^ 


30. J4 (Z4.o(J) 




Frequency of quality' performance on the agenda of Board meetings, (*/o) 






Never on the agenda for meetings 


9 /1 9n\ 

z (i.^y) 




Few meetings 


43 (Z / . / 4) 




Most meetings 


o4 (34. iV) 




Every meeting 


ZD (10. / /) 




Perceived external pressure (range 0—36), mean (SD) 


iy.4V (3.ooj 




Quality Management System Index (range 0—27), mean (SD) 


1 0 1 M /I QN 




Quality Management Compliance Index^ (range 0—16), mean (SD) 


1 n c;9 1 Q\ 
1U.3Z (J.loj 




Clinical Oualitv Implementation Index^ (range 0—14), mean (SD) 


8.39 (2.99) 




Respondent characteristics 






Sex, n (%) 


CEO 


QM 


Male 


132 (85.16) 


48 (30.97) 


Female 


23 (14.84) 


107 (69.03) 


Age (years), mean (SD) 


52.64 (6.80) 


45.01 (8.81) 


Number of years as in job, mean (SD) 


5.03 (4.33) 


4.61 (3.16) 


Background in healthcare 






No 


14 (9.03) 




Yes 


141 (90.97) 





"Audit data were collected in 63 of 155 hospitals in this study. Hospital characteristics of these 63 hospitals were similar to those of the 155 
hospitals. 

''Information on number of executive board members missing in 1 1 hospitals. 
"^Information on number of executive board meetings in the last year missing in 10 hospitals. 



8.39 ± 2.99 on CQII (on a scale of 0 to 14), meaning that proto- 
cols existed in most of the seven areas of clinical qualitjr efforts, 
but that they were less frequendy monitored and measured. 

Perceptions of external pressure 

On the whole, CEOs indicated that their hospital's quality 
management system is only moderately influenced by external 



pressures (PEP score = 19.49 ± 5.88 on a scale of 0—36), with 
an inter-quartile range of 8.6 between the first and the third 
quartile. 'Governmental poUcy' and 'legislation for internal 
quahty systems' were perceived to have the most influence 
(Table 2), which were similar for all seven countries. Albeit 
that the external factors that appeared to have the least influ- 
ence were missing more frequendy, the missing values were 
not considered systematic. 
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Table 2 Descriptive statistics for items used to calculate the PEP score (» — 155) 



External influencing factors^ 


Mean 


SD 


Floor (% with 
lowest score) 


Ceiling (% with 
highest score) 


Frequency of 
missing data 


Governmental policy on quality and safet}' in healthcare 


1.59 


0.57 


4 


63 


1 


Legislation for internal quality systems 


1.56 


0.58 


5 


59 


4 


Public health, sanitary inspection 


1.46 


0.64 


8 


53 


3 


Hospital accreditation 


1.45 


0.77 


16 


59 


7 


Quality system certification (ISO 9004) 


1.37 


0.76 


16 


51 


8 


Statutory inspection to maintain institutional license, 


1.33 


0.73 


15 


46 


5 


registration 












Accreditation of clinical training 


1.29 


0.68 


12 


40 


7 


Publication disclosure of hospital performance data 


1.23 


0.61 


9 


32 


6 


(e.g. public hospital comparisons, star ratings or league 












tables) 












Public relations, media pressure 


1.12 


0.63 


14 


25 


8 


Market competition advantage 


1.03 


0.68 


20 


23 


10 


Requirements for public Uabilit}', malpractice insurance 


0.90 


0.72 


24 


23 


13 


Clinical professional associations, colleges, societies 


0.87 


0.63 


25 


13 


11 


Professional chambers/regulators 


yj.oD 


w.ov 


jyj 


iO 


ID 


Health insurance funds 


0.78 


0.76 


37 


18 


16 


Technology assessment bodies, e.g. HAS, NICE, SIGN 


0.71 


0.78 


43 


17 


21 


Condition for access to funding, e.g. as 'preferred 


0.66 


0.76 


45 


15 


19 


provider' 












Hospital associations 


0.57 


0.65 


47 


8 


14 


Ombudsman 


0.57 


0.64 


46 


7 


17 



"All external influencing factors were rated on a scale range of 0—2; 0, no influence; 1 , moderate influence; and 2, major influence. 



Table 3 Regression coefficients (standard errors) for the associations of having quality performance on the executive board's 
agenda and hospital level quality measures QMSI, QMCI and CQII, and the modifier PEP 





QMSr (« = 


155) 


QMCr (« = 


63) 


CQir (/? = 63) 




h (SE) 


P-value 


b (SE) 


P-value 


b (SE) 


P-value 


Frequency of qualitjr on executive board's agenda 












Every meeting 


2.53 (1.16) 


0.030 


1.23 (1.32) 


0.355 


1.85 (1.16) 


0.117 


Most meetings 


1.62 (0.78) 


0.040 


0.86 (0.90) 


0.340 


1.81 (0.77) 


0.023 


Never/ few meetings 


Ref 


Ref 


Ref 


Ref 


Ref 


Ref 


Perceived external pressures score (PEP) 


0.06 (0.06) 


0.364 


0.03 (0.08) 


0.701 


0.07 (0.07) 


0.369 



"Adjusted for country, CEO background in healthcare, hospital teaching status, ownership tjfpe, number of beds. Interaction effects of the 
quality agenda and PEP were not significant for any outcome measure and therefore not shown. 



Quality as an item on the executive board's agenda 
and the implementation of quality management 

Table 3 details the regression coefficients, standard errors and 
P-values from the multivariable adjusted regression models of 
frequency of having qualit}' performance on the executive 
board's agenda as predictor of QMSI, QMCI and COIL After 
adjusting for CEO background in healthcare and hospital 
characteristics (teaching status, ownership type and size), hos- 
pitals where the executive boards had qualitjr on the agenda 
during every meeting scored 2.532 units higher on QMSI 



compared with hospitals with executive boards that discussed 
it during few meetings or never (SE = 1.16; P = 0.03). We also 
looked at modification effect of PEP on the relationship 
between the frequency of having quaUtjr on the agenda and 
QMSI by redoing the analysis without PEP, but did not find a 
significant effect. 

Table 3 also details the regression coefficients for the fre- 
quency of having quality performance on the executive board's 
agenda as predictor of OMCI. Although our results were non- 
significant, we observed positive associations between frequency 
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of quality on the agenda and QMCI. No effect or modification 
effect was found for PEP on the association between fre- 
quency of quality on the agenda and QMCI. 

AU else held constant, on average CQII score was higher 
when executive boards had quality performance on the agenda 
during most meetings (/;=1.81, SE = 0.77, P = 0.02) or 
during every meeting (/;'=1.85, SE = 1.16, P = 0.11), when 
compared with hospitals where quality was discussed never or 
at a few meetings. We did not find a modification effect of 
PEP on this relationship. 

Discussion 

The aim of this study was to assess how frequently executive 
boards in European hospitals have quality as an item on their 
agenda, and whether this frequency is associated with the im- 
plementation of hospital quality management. We have 
demonstrated that executive boards which take an interest in 
quality performance, as indicated by having the item on the 
agenda, are more likely to have a quality management system 
in place. 

Agenda-setting is an important aspect of prioritization [7], 
and ultimately for hospital governance. In order to take action, 
executive boards should receive information about quality per- 
formance, review and discuss it during meetings, and make the 
right decision accordingly [31]. Having quality as an item on 
the executive board's agenda is also important symbolically as 
it signals their quality orientation to the rest of the hospital, 
and ultimately obtain more resources than those who do not 
[32]. Therefore, having quality as an item on the agenda fits 
well within QI cycles. Frequent discussions of quality perform- 
ance demonstrate that executive boards consider quality of 
care to be an important topic and provides the opportunity to 
ascertain the implementation of the quality management 
system. The association with quality management could also 
mean that having a widely implemented quality management 
system requires executive boards to have many meetings to 
cover all its different subdimensions. Either way, discussing 
quality performance seems to be an essential lever for imple- 
menting and sustaining hospital-wide quality management. 
The non-significant trend with compliance (QMCI) and clinic- 
al implementation (CQII) of quality management could be 
attributed to the lower number of hospitals participating in the 
audit study. However, in order to get a better understanding of 
the role of executive boards and clinicians in quality manage- 
ment, further and more sustained research is needed to investi- 
gate the relationship with quality strategies at pathway level. 

Also this article reports on the CEO's ranking of PEP. 
Although we did not find a modification effect of PEP, we did 
find that CEOs experienced pressure from external factors. 
Where external pressure from patient demands, financial pres- 
sure and market competition increase, executive boards are 
under increasing scrutiny to shift their focus in decision- 
making [33—35]. For example, publicly reported performance 
data can lead to increased managerial commitment to quality 
of care, reshape organizational priorities, and create a sense of 
accountability [5]. In previous studies, quality management 



systems were found to be more apparent in hospitals that were 
subject to accreditation and certification [36, 37]. 

Limitations 

Common limitations of the DUQuE project are described 
elsewhere [27]. Our study has a number of specific limitations. 
First, the information we obtained via questionnaires was 
based on self-reported data, which might induce socially desir- 
able bias and false-positive results. We tried to minimize this 
by designing factual questions rather than asking for personal 
opinions as much as possible. By using different data sources, 
we tried to avoid the common problem of method variance. 
Second, our aggregation methods could have influenced the 
outcome of the regression analyses. However, we used vali- 
dated scales as much as possible. Third, international research 
on external pressure needs to take account and control for im- 
portant confounding contextual and local contingent differ- 
ences across countries that may influence the findings. 
Therefore, we corrected for country differences in the ana- 
lyses. So far, we have not been able to find an instrument that 
aims to include in a single tool the capacity to rank the per- 
ceived importance of different types of external pressure. It is 
not the goal of this paper to validate this instrument, but this 
publication appears to be the first attempt to measure this 
concept. Last, we collected quantitative rather than qualitative 
data. Albeit that qualitative research could give more insight in 
what\% discussed when quality performance is on the executive 
board's agenda, and how the required information is acquired 
and used, for now it is a promising start to have determined 
the aforementioned relationships quantitatively. 

Practical implications 

Executive boards are legally responsible for the hospital's 
quality performance, and this article demonstrates that they can 
make a difference. Frequent discussions of quality performance 
in the executive board room wiU keep them informed and 
stimulate the implementation of quality management. Our pan- 
European study design, including public teaching and non- 
teaching hospitals, provides important cross-national lessons for 
hospitals as they seek to improve the quality of care they deliver 
to patients. 

Conclusions 

Having quality on the executive board's agenda allows them to 
review and discuss quality performance more often in order to 
improve their hospital's quality management. Generally, and 
our study supports this, having quality on the executive board's 
agenda therefore matters. 
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